Transfer Learning-enabled Action Recognition for Human-robot Collaborative Assembly
نویسندگان
چکیده
Abstract Human-robot collaboration (HRC) is critical to today’s tendency towards high-flexible assembly in manufacturing. Human action recognition, as one of the core prerequisites for HRC, enables industrial robots understand human intentions and execute planning adaptively. However, existing deep learning-based recognition methods rely heavily on a huge amount annotation data, which may not be effective or realistic practice. Therefore, transfer learning-enabled approach proposed this research facilitate robot reactive control HRC assembly. Meanwhile, decision-making mechanism robotic introduced well. Lastly, evaluated an aircraft bracket scenario reveal its significance.
منابع مشابه
Manipulative Action Recognition for Human-Robot Interaction
Recently, human-robot interaction is receiving more and more interest in the robotics as well as in the computer vision research community. From the robotics perspective, robots that cooperate with humans are an interesting application field that is expected to have a high future market potential. A couple of global and also mid-sized companies have come up with quite sophisticated robotic plat...
متن کاملA Human-Robot Collaborative Reinforcement Learning Algorithm
This paper presents a new reinforcement learning algorithm that enables collaborative learning between a robot and a human. The algorithm which is based on the Q(λ) approach expedites the learning process by taking advantage of human intelligence and expertise. The algorithm denoted as CQ(λ) provides the robot with self awareness to adaptively switch its collaboration level from autonomous (sel...
متن کاملSequential Deep Learning for Human Action Recognition
We propose in this paper a fully automated deep model, which learns to classify human actions without using any prior knowledge. The first step of our scheme, based on the extension of Convolutional Neural Networks to 3D, automatically learns spatio-temporal features. A Recurrent Neural Network is then trained to classify each sequence considering the temporal evolution of the learned features ...
متن کاملMachine Learning for Continuous Human Action Recognition
In this term project, we consider the problem of automatic recognition of continuous human activity. Our source data are short videos with RGB and depth information of seven predefined categories of human action as well as long videos that contain a series of continuous actions. By extracting frame-level features that represent each action and are invariant to small environmental noise, we trai...
متن کاملRecurrent Neural Networks and Transfer Learning for Action Recognition
We have taken on the task of action recognition, the classification of videos depicting human action from the UCF101 dataset. In this paper, we present our experiments with a variety of recurrent neural networks trained on sequences of CNN ‘codes’ generated by AlexNet. Our results with these models indicate similar performance enhacements over baseline methods as found in modern literature, as ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Procedia CIRP
سال: 2021
ISSN: ['2212-8271']
DOI: https://doi.org/10.1016/j.procir.2021.11.303